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CHAPTER  L  INTRODUCTION 

1J)  Introduction 

Digital  signal  processing  is  a  dynamic,  rapidly  growing  field,  but  its 
fundamentals  are  well  established  [1,2].  The  techniques  and  applications  of 
digital  signal  processing  are  expanding  at  a  tremendous  rate.  With  the  advent 
of  large  scale  integration  and  the  resulting  reduction  in  cost  and  size  of  digital 
components  together  with  increasing  speed,  the  number  of  applications  of  digital 
signal  processing  techniques  is  growing.  Special  purpose  digital  filters  can  now 
be  implemented  in  the  megahertz  range,  and  simple  digital  filters  have  been 
integrated  on  circuit  chips.  Digital  processors  also  form  an  integral  part  of 
many  modem  radar  and  sonar  systems.  When  digital  filters  are  coupled  with 
the  advantages  of  adaptive  systems  the  results  can  be  very  exciting  [3,4]. 
Adaptive  filters  have  distinct  advantages  over  fixed  parameter  and  operator 
adjustable  systems  for  many  applications.  Fortunately,  most  digital  filters  can 
be  made  adaptive  through  the  use  of  an  adaptive  updating  algorithm. 

At  UCD  over  the  past  several  years  graduate  students  have  been  studying 
digital  adaptive  filtering  under  a  contract  from  the  United  States  Air  Force  [5] . 
One  project  funded  under  this  contract  was  to  simulate  and  build  a  digital 
adaptive  filter  which  would  run  at  a  very  high  sampling  rate.  This  filter  is 
discussed  in  a  paper  by  M.A.  Soderstrand  and  3.K.  Kelley  [6]  in  which  a  hardware 
design  is  suggested  and  a  report  is  made  on  the  filter  simulation. 

The  purpose  of  this  thesis  is  to  further  develop  this  hardware  and  to 
study  the  performance  and  certain  characteristics  of  this  computer  simulation 
as  they  apply  to  the  hardware  design  of  the  filter.  (See  Appendices  A  and  B 
for  computer  program  and  simulated  system  diagram.)  Specifically,  we  will: 


1. 


Firm  up  the  hardware  design  lor  the  adaptive  part  of 
the  system. 

2.  Carry  out  a  detailed  simulation  of  this  adaptive 
hardware. 

3.  Draw  conclusions  as  to  the  optimum  adaptive  hardware 
configuations. 

During  the  process  oi  this  study  our  focus  will  remain  on  the  hardware 
implementation  (to  be  carried  out  at  some  later  date).  Thus  our  choice  for 
filter  structure  and  adaptive  algorithm  are  very  much  dependent  upon  the  fact 
that  this  filter  will  be  built  and  not  merely  simulated. 
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2j0  FIR  Filter  Hardware 

2.1  Pipelined  FIR  Filter 

The  filter  structure  chosen  for  our  adaptive  filter  is  the  8-weight  pipelined 
Tapped  Delay  Line  filter  (PTDL)  shown  in  Figure  la  [7]  which  evolved  from 
the  classical  Tapped  Delay  Line  filter  (TDL)  of  Figure  lb. 

The  PTDL  of  Figure  la  has  a  sampling  rate  7  times  faster  than  that  of 
the  TDL  of  Figure  lb  due  to  the  parallel  processing  of  all  the  partial  sums  with 
each  other.  From  straightforward  analysis  the  difference  equation  of  the  PTDL 
filter  is 

7 

y(i)  =  l  a.x( i-2-j) . 
j=o  1 

This  can  be  compared  to  the  difference  equation  of  the  TDL  which  is 

7 

y ( i )  -  [  a.x(i-j). 
j=o  1 

It  is  clear  that  the  effect  of  pipelining  is  to  delay  the  output  by  two  time 
samples.  The  PTDL  filter  could  be  extended  from  8  to  any  desired  number  of 
filter  weights. 

22  RNS  Implementation 

The  Residue  Number  System  (RNS)  becomes  extremely  useful  in  the 
hardware  implementation  of  the  digital  filter  [8-16].  Ve  have  chosen  the 
moduli  11,  13,  13,  and  16  due  to  the  range  of  numbers  required.  The  PTDL  is 
implemented  in  modular  arithmetic  for  each  of  the  four  moduli  in  parallel.  This 
parallel  structure  requires  no  arithmetic  carries  as  would  be  required  in  a  binary 
system.  The  sampling  rate  of  an  RNS  filter  can  thus  be  much  faster  than  that 
of  a  binary  system  [17]. 
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In  practice  one  must  generally  convert  binary  to  residue  for  processing 
and  after  processing  convert  back  to  binary.  The  conversion  from  binary  to 
residue  is  quite  simple,  usually  done  by  straight  tablt  ’ook-up  [18].  The 
conversion  back,  although  somewhat  more  complex,  is  relatively  simple.  Several 
techniques  exist  for  this  RNS  to  binary  convergence  including  mixed  radix 
conversion  [18-20]  and  conversion  based  on  the  Chinese  reminder  theorem 
[19,21]. 

Figure  2  shows  the  basic  hardware  for  one  modulus  of  the  digital  filter. 
The  hardware  for  each  modulus  is  identical  except  for  the  arithmetic  tables 
stored  in  the  ROMs.  Each  weight  is  implemnted  by  a  256x4  ROM  with  4  of 
the  8  address  bits  selected  by  the  modulus  weight  a..  Each  adder  is 
implemented  by  a  256x4  ROM  with  the  8-bit  address  selected  by  the  two  4-bit 
modulus  mk  numbers  to  be  added.  Each  moduli  of  the  FIR  filter  requires  2n-l 
ROMs  and  2n  delays  for  n  weights.  For  our  8-weight  filter  each  modulus  has 
15  ROMs  and  16  delays,  resulting  in  a  total  of  60  ROMs  and  64  delays. 

23  Adaptive  Filter 

This  PTDL  filter  can  now  be  used  in  an  adaptive  system.  An  adaptive 
filter  structure  must  be  chosen  with  which  to  test  the  filter,  and  an  adaptive 
algorithm  must  be  chosen  to  update  the  filter  weights. 
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3JD  Adaptive  Filter  Design 
3.1  Adaptive  Filter  Structure 

Adaptive  filtering  is  a  very  useful  tool  in  filter  design.  Adaptive  filters 
can  be  used  in  many  different  structures  to  perform  many  different  tasks.  Ve 
would  like  to  choose  one  of  these  structures  in  which  to  test  our  filter.  Most 
uses  for  adaptive  filters  can  be  grouped  into  four  categories: 


(1) 

System  Identification 

(Figure  3) 

(2) 

Noise  Cancellation 

(Figure  4) 

(3) 

Channel  Enhancement 

(Figure  5) 

(4) 

Model  Reference 

(Figure  6) 

The  adaptive  filter  in  each  configuration  is  a  separable  addition  to  the 
original  system.  From  the  viewpoint  of  the  adaptive  filter  the  system  which 
contains  it  is  a  black  box.  The  filter  receives  signals  from  the  system  and 
outputs  signals  to  it.  An  adaptive  filter  will  work  independently  of  the  type 
of  system  it  is  in.  Since  the  purpose  of  this  paper  is  to  study  adaptive  filtering 
and  not  uses  for  adaptive  filters,  we  have  chosen  the  System  Identification 
configuration  with  which  to  test  our  filter.  System  ID  is  the  simplest  of  the 
four  configurations  and  thus  simplifies  our  study. 

3.2  Adaptive  Algorithm 

Adaptive  systems  adapt  by  means  of  minimizing  (or  optimizing)  some 
system  parameter.  This  parameter  is  measured  by  an  Index  of  Performance  (IP) 
function  frequently  expressed  in  the  form 

3(c)  *  f  f(e,c,t)dt 


where  e  is  the  error  representing  the  deviation  of  the  system  parameter  from 
the  desired  value,  c  is  a  set  of  independently  adjustable  variables,  and  t  is  time. 


Figure  % 

Noise  Cancellation 


Each  of  the  four  configurations  in  which  adaptive  filters  are  used  has  an 
•error'  e  which  is  used  by  an  IP  function.  For  System  Identification  e  is  the 
difference  between  the  unknown  and  the  adaptive  filter  outputs.  The  error  e 
for  Noise  Cancellation  systems  is  the  approximate  input  signal  x  which  approaches 
x  as  adaptation  cancels  the  noise.  Channel  Enhancement  error  e  is  the  difference 
between  the  original  and  channel-distorted  signals  n  and  should  approach  zero. 
In  Model  Reference  systems  e  is  the  deviation  of  the  actual  system  output  from 
the  ideal  output.  For  each  system,  c  is  the  set  of  adaptive  filter  weights. 

There  are  many  possible  IP  functions  which  we  could  choose  to  minimize 
in  our  adaptive  filter.  Only  the  two  most  common,  Least  Mean  Squares  and 
Least  Squares,  were  considered  for  this  study. 

3.2.1  Least  Mean  Squares 

The  first  of  these  two  Index  of  Performance  functions  is  the  Least  Mean 
Squares  (LMS)  in  which  J(w)=Ele.2]  is  minimized  [22].  In  this  case  c  (the 
independent  variables)  are  the  unknown  filter  weights  w.  The  System 
Identification  configuration  for  our  system  looks  like  that  in  Figure  7.  The 
error  at  time  j  is 

e .  =  d.  -  y .  =  d .  -xT-w. 

J  J  J  J  J-2 

The  square  of  the  error  is 

'i  '  di2  -  2di  Xi-2  W  *  WV2  XI-2  W‘ 

The  mean  square  error  (  (which  equals  3(w»  is 

5  $  E[e.2]  =  Eld.2]  -  2  E[d.  xj^  w  ♦  wTE[x._2  xl]  2)  w 
=  Eld.2]  -  2  PT  w  4  wTRw. 


.  .  - - ' - 


where  P  Is  defined  as  the  cross  correlation  vector  between  the  input  signal 
and  the  desired  response,  E  [d.^x^h  and  R  is  the  input  correlation  matrix, 

T 

EIxj_2  x  j_jl  •  C  is  a  quadratic  function  of  the  adaptive  filter  weights,  and  has 
an  n-dimensionai  bowl  shape  as  shown  in  Figure  t. 

£  can  be  minimized  by  means  of  a  gradient  search  using  the  following 
steepest  descent  recursive  algorithm: 


1 


Vi  *  *i  * "  <-v 


where 


V.  *  «  -2P  ♦  2R  w. 

i  dw'w  s  w.  i 


and  y  is  the  step  size. 

This  recursive  equation  is  known  as  the  Least  Mean  Squares  (LMS) 

algorithm.  In  practice  this  form  of  the  algorithm  is  not  useful  because  P  and 

2 

R  are  not  known.  An  estimate  of  the  mean  square  error  is  £  *  [e.  ]  which 
gives  us  as  approximate  gradient 


1  *  -2ei  xr 


The  approximate  LMS  algorithm  is  then 


WH  1  wi  *  2“'i  "i 


which  is  very  easy  to  apply  in  practice. 

There  are  variations  of  the  LMS  algorithm  which  can  converge  faster  than  the 
LMS.  The  most  popular  of  these  is  the  Normalized  LMS  (NLMS)  with  updating 
formula 


1* 


WH  =  w<  + 


1  I  |Xj|  | 


e.  x.. 


2  J  J 


This  algorithm  will  converge  faster  than  the  LMS,  but  requires  more  hardware 
to  be  implemented. 


3.2.2  Least  Squares 

The  second  important  Index  of  Performance  function  is  the  Least  Squares 
where  3(w)  =  J  e.  is  minimized.  In  System  Identification  the  problem  is  to 

j  1 

determine  the  unknown  weights.  This  is  done  in  a  method  similar  to  that  of 
the  LMS  update  equation.  This  recursive  formula  is 


where 

and 


T 

w.  ,  a  w.  +  Y-  I  P-  x.  . [y.  ,  -  x.  ,  w. ] 
j+1  j  VI  j  j+llVl  )+l  J 


P.  ,  =  P.  -  Y.  .  P.  X.  ,  X*  ,  P. 

J+1  J  ’j+l  J  J+1  J+1  J 


*j.l  *  1/11  *  xj.i  pj  XM> 


Therefore,  by  starting  with  an  initial  estimate  wq  and  PQ,  w  can  be  sequentially 
updated  while  new  observations  are  continuously  obtained. 

32J  Choice  of  Algorithm 

The  main  criterion  used  to  choose  an  adaptive  algorithm  for  our  system 
was  complexity  of  hardware  required.  This  is  due  to  limited  board  space  and 
cost  factors  of  the  filter.  A  key  factor  in  the  hardware  selection  is  the  fact 
that  in  order  to  update  n  weights,  it  takes  n  operations  [17].  Thus  for  a 
practical  number  of  weights,  each  update  operation  must  be  very  simple. 

Contrary  to  what  might  be  expected,  number  of  iterations  for  convergence 
was  not  a  major  criterion  used  to  choose  an  algorithm.  Input  signals  to  the 


filter  are  assumed  to  be  in  the  audio  range.  The  basic  sampling  rate  is  10MHz, 
hence  10,000  iterations  can  be  made  in  one  millisecond.  If  this  were  not  the 
case,  number  of  iterations  for  convergence  might  alter  the  choice  of  algorithm. 

Given  the  criterion  for  simple  hardware  the  obvious  choice  of  adaptive 
algorithm  for  our  filter  is  the  Least  Mean  Squares.  It  requires  relatively  simple 
hardware  and  is  fast  enough  for  our  purposes. 

3.2.*  Hardware  Implementation  of  LMS  Algorithm 

The  hardware  chosen  and  simulated  by  3.K.  Kelley  for  the  LMS  adaptive 
algorithm  is  shown  in  Figure  9.  Eight  bits  are  available  with  which  to  represent 
the  input  x  and  the  error  e.  The  8  bits  must  somehow  be  divided  between  x 
and  e.  Here  we  can  see  that  a  hardware  implementation  can  considerably 
decrease  the  accuracy  of  an  adaptive  algorithm.  The  number  of  bits  allowed 
for  x  is  called  NXBIT.  One  bit  of  8  is  used  for  the  sign  of  (eXx)  leaving 
7-NXBIT  bits  to  represent  e. 

The  purpose  of  this  thesis  is  to  study  this  division  of  the  bits  between  e 
and  x.  We  will  find  which  division  gives  the  fastest  convergence  and  how  the 
optimum  step  size  is  affected  by  the  division.  We  will  also  show  how  the  rate 
of  convergence  and  optimum  step  size  are  affected  when  the  adaptive  and 
unknown  filters  have  different  numbers  of  weights. 


Unknown 

Filter 


Figure  9 

Adaptive  Filter  with  Updating  Algorithm 
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CHAPTER  IL  PROCEDURE 
1.0  Introduction 

As  discussed  in  Chapter  1,  the  purpose  of  this  thesis  is  to  study  how  the 
rate  of  convergence  and  optimum  step  size  p*  are  affected  by: 

i)  the  division  of  bits  between  e  and  x 

ii)  the  number  of  weights  in  the  unknown  filter 

The  results  of  this  study  will  define  a  pQ  and  NXBIT  for  optimum  convergence 
to  be  used  in  the  adaptive  filter  hardware  shown  in  Figure  9. 

Figure  9  shows  the  update  hardware  for  the  digital  adaptive  filter.  A 
more  detailed  picture  of  the  hardware  is  shown  in  Figure  10a  for  the  case  when 
3  bits  of  the  input  x  and  4  bits  of  the  error  e  are  used  to  calculate  the  weight 
adjustment  vector  2pQex.  The  update  quantity  is  calculated  in  the  ROM  and 
assumes  that  e  and  x  are  in  2's  complement  binary  form.  Thus  the  ROM  needs 
the  sign  of  (eXx)  in  order  to  calculate  the  correct  update  quantity.  This  leaves 
7  bits  to  divide  between  e  and  x. 

A  different,  and  probably  better,  hardware  implementation  is  discussed  in 
Chapter  III  which  assumes  e  and  x  are  in  sign-magnitude  binary  form.  For  this 
case  the  sign  of  (eXx)  need  not  be  fed  into  the  ROM,  but  can  multiply  the 
result,  leaving  8  bits  to  divide  between  e  and  x.  This  method  is  shown  in 
Figure  10b. 


Figure  10b 

Update  Hardware  Using  Sign-Magnitude  Numbers 


19 


2.0  Optimum  Step  Size 

The  Least  Mean  Squares  adaptive  algorithm  updates  the  adaptive  filter 
weights  using  the  recursive  formuia  w.+J  =  w.  +  2ye.x.,  where  y  is  the  step 
size.  In  general,  two  aspects  of  the  step  size  are  of  interest:  the  maximum 
allowable  gain  y  for  stability,  and  the  optimum  y*  for  fastest  convergence 

iTiaX 

123]. 

It  has  been  shown  that  for  the  LMS  algorithm  to  converge  [22]  y  must 
be  bounded  as 


where 


0  < 


y  <  y 


max 


_  2 

ymax  trR 


(1) 


As  seen  in  Chapter  I,  R  is  the  input  correlation  matrix  defined  by 

R  =  E[xkxJ]. 

Gitlin  and  Weinstein  [24]  showed  that  the  y  which  achieves  maximum 
rate  of  convergence  y*  is 


y* 


s  h  y, 


max 


(2) 


In  practice  R  is  not  known  and  another  more  practical  form  of  the  equation 
y*  must  be  found.  In  work  recently  done  by  Gardner  [25]  a  more  practical 
form  is  obtained: 


2 


(3) 


w  s 


=  2  y* 


The  input  vector  is  assumed  to  be  Gaussian  with  independent  and  identically 
distributed  elements.  N  is  the  order  of  the  adaptive  filter. 

The  adaptive  filter  we  have  used  is  7th  order  and  the  standard  deviation 
(o)  of  the  input  signal  used  for  simulation  is  .30.  According  to  equation  3  we 
should  ideally  have 


•w  ■ 2M  -- 2v *• 

The  Residue  Number  System  requires  that  the  non-integer  input  signal  be  scaled 
by  the  factor  SCALE,  which  for  our  system  is  130.  (See  Appendix  B  for 
calculation  of  SCALE.)  This  acts  to  divide  the  step  size  by  SCALE  so  that  the 
ideal  optimum  step  size  will  be 

V*'  =  y*/SCALE  =  .0094 

2.1  Determination  of  Optimum  Step  Size 

In  the  last  section  we  discussed  the  ideal  optimum  step  size  y#  and  gave 
equations  to  calculate  it.  In  order  to  find  the  optimum  step  size  yQ  to  use  in 
our  hardware,  a  strategy  must  be  designed  with  which  to  obtain  the  optimum 
U  from  the  data  output  of  our  computer  simulation.  Our  simulation  plots  the 
ensemble  averaged  output  error.  An  ensemble  averaged  curve  is  simply  the 
average  of  a  number  of  such  individual  curves  and  approximates  the  adaptive 
behavior  in  the  mean. 

The  optimum  step  size  is  the  value  of  y  which  minimizes  the  mean  square 


errors 


This  is  a  commonly  used  technique  which  is  consistent  with  the  fact  that  we 
have  chosen  the  Least  Mean  Squares  adaptive  algorithm  which  also  minimizes 
the  mean  square  error.  K  is  the  number  of  iterations  chosen  to  average  over 
and  is  larger  than  the  number  of  iterations  required  for  the  error  curve  of  each 
Vi  value  to  settle.  Ideally  K  would  be  infinity,  but  fortunately  we  may  adequately 
estimate  y*  with  a  relatively  small  K  (approximately  1,000  for  our  case).  This 
method  of  finding  y*  is  very  easy  to  implement  in  our  simulation. 

The  ensemble  averaged  output  error  ideally  has  the  form  of  an  exponential: 

e(t)  =  kf0* 

In  practice,  however,  the  output  error  has  an  'error  floor'  that  is  due  to  hardware 
approximations.  This  error  floor  is  represented  by  k2  in  the  non-ideal  exponential 
form  of  output  error: 

e(t)  =  kje-at  +  k2 

The  output  error  curves  cannot  drop  below  the  error  floor,  therefore,  the  number 
of  iterations  to  average  K  can  be  determined  by  observing  when  the  error  curves 
have  settled  to  k^ 

2.2  Effects  of  Truncating  x  and  Limiting  e 

As  discussed  in  section  3.2.4  of  Chapter  I,  8  bits  are  available  with  which 
to  represent  the  input,  the  error,  and  the  sign  of  the  product  of  input  and  error 
in  the  adaptive  algorithm.  The  approximation  for  x  x'  is  found  by  simply 


truncating  x  to  NXBIT  bits.  The  approximation  for  e  e",  however,  is  found  by 
saturating  at  e=2**<7-NXBITM  if  e  is  too  large  to  be  represented  with  7- NX  BIT 
bits.  This  is  done  in  order  to  obtain  sensitive  adaptation  near  convergence. 
Plots  of  x  and  e  as  they  are  approximated  to  x'  and  e'  are  shown  in  Figures  lla-e. 
These  approximations  will  affect  the  error  floor  and  the  rate  of  convergence 
of  our  simulations. 

It  can  be  shown  that  the  rate  of  convergence  is  affected  by  both  the 
saturation  of  e  and  the  truncation  of  x.  However,  as  convergence  is  approached 
the  error  becomes  small  and  is  thus  no  longer  saturated. 

Similarly,  saturation  of  e  does  not  affect  the  error  floor  because  as  the 
error  floor  (convergence)  is  reached  e  is  not  saturated.  Truncation,  however, 
has  an  effect  on  the  error  floor,  but  its  effect  may  be  masked  by  finite  arithmetic 
errors  which  are  due  to  integer  arithmetic  used  in  the  filter. 

These  facts  will  be  supported  with  data  in  Chapter  ID.  In  particular,  we 
shall  see  that  the  error  floor  is  primarily  determined  by  the  finite  arithmetic 
and  that  the  rate  of  convergence  is  mainly  affected  by  the  saturation  of  e  and 
the  truncation  of  x. 


2.3  Filter  Order  Mismatching  Error 

Part  of  this  study  is  to  make  conclusions  on  how  rate  of  convergence 
and  optimum  step  size  are  affected  by  the  number  of  weights  in  the  unknown 
filter.  The  adaptive  filter  used  will  have  8  weights  (7th  order),  and  for  simulation 
any  number  of  weights  can  be  entered  for  the  unknown  filter.  However,  when 
the  filter  is  built  and  used  the  unknown  filter  will  be  just  that,  unknown,  and 
may  have  any  number  of  weights.  For  this  reason  we  will  simulate  the  hardware 
using  unknown  filters  of  7,  8  and  9  weights.  This  will  enable  us  to  draw 
conclusions  about  unknown  filters  of  less  than,  equal  to,  and  greater  than  8 
weights. 


Figure  lid 

Approximations  of  x  and  e  -  NX  BIT  *  3 


For  this  simulation  we  have  chosen  the  FIR  lowpass  filters  with  ail  zeros 
at  z  i  .1  on  the  unit  circle.  This  choice  of  unknown  filters  is  essentially 
arbitrary,  although  our  goal  is  to  choose  filters  wtih  similar  properties.  The 
transfer  functions  are: 

7  weights:  z^  +6z3  ♦15z<*  +20z3  +15z2  +6z  +1 

8  weights:  z7  +7z6  *21z5  *35zU  *35z3  +21z2  +7z  +1 

9  weights:  zS  +8 z7  +28z6  +56z5  +70z4  +56z3  +28z2  +8z  +1 

This  mismatching  of  filter  orders  can  be  thought  of  as  system  noise, 

which  is  represented  by  N  in  Figure  12.  This  noise  will  act  to  add  misadjustment 
error  to  the  system  which  may  decrease  y*  from  the  ideal  y*. 
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3.0  Simulations 

In  order  to  find  NXBIT  and  yQ  which  will  optimize  the  filter  hardware 
and  to  study  filter  order  mismatching  error  we  will  find  and  compare  the  optimum 
convergence  rate  yft  for  different  combinations  of  NXBIT  (number  of  bits  to 
which  x  is  rounded)  and  NU  (number  of  unknown  filter  weights).  The  combinations 
which  will  be  simulated  to  find  yft  are  shown  in  Table  1.  Results  of  these 
simulations  are  given  in  Chapter  III. 


Table  1. 

Optimum  Step  Size 


NXBIT 

NU 

7 

8 

9 

0 

y*07 

^  *08 

11  *09 

1 

W*i7 
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W#19 

2 

e 

e 

e 

3 

e 

e 

• 

4 

e 

• 

• 

5 

a 

e 

• 

6 

^  *67 

W#69 

^5 
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CHAPTER  m.  RESULTS 
1.0  Introduction 

As  discussed  in  Chapter  n,  the  purpose  of  this  thesis  is  to  define  an 
optimum  step  size  yQ  and  NXBIT  for  optimum  convergence  to  be  used  in  the 
adaptive  filter  hardware.  The  values  yft  of  Table  1  have  been  obtained  by 
finding  the  step  size  which  minimizes  the  mean  square  error  as  discussed  in 
section  2.1  of  Chapter  n. 

In  this  chapter  yQ  and  NXBIT  are  obtained,  and  the  effects  of  mismatching 
error  are  discussed.  Also  discussed  is  a  better  hardware  system  using  sign- 
magnitude  binary  numbers  as  opposed  to  2's  complement  numbers. 
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2.0  Results 

2.1  Determination  of  Optimum  Step  Size 

Ve  have  defined  the  optimum  step  size  y*  as  the  step  size  which  minimizes 
the  mean  square  error: 


For  our  case  K  is  constant  lor  ail  values  of  y  so  that  y*  is  the  step  size 
which  minimizes  the  total  error: 

K 

j=l  1 

Figure  13  shows  the  output  error  curves  and  total  error  of  different  y 

values  for  NXBIT  =  3  and  NU  =  8.  The  range  of  step  sizes  simulated  was 

.003  -  .011  with  increments  of  .001,  but  only  three  of  these  were  plotted  for 
the  sake  of  clarity.  As  y  is  decreased  from  .011  the  total  error  decreases 
until  a  minimum  is  reached  at  y*.  As  y  is  decreased  from  y*  the  total  error 
increases  without  limit.  If  total  error  were  plotted  as  a  function  of  y  the 
function  would  have  a  bowl  shape  as  shown  in  Figure  14.  For  the  example 
shown  in  Figure  13  y  ^  is  .007. 

2.2  Resulting  Optimum  Step  Sizes 

The  method  discussed  in  the  last  section  was  applied  to  every  combination 

of  NXBIT  AND  NU  to  determine  all  y*.  These  values  are  given  in  Table  2. 

The  total  error  for  each  of  the  cases  is  plotted  in  Figure  15.  The  output  error 
curves  and  adaptive  filter  weight  plots  are  found  in  Appendix  C. 


Different  Values  of  Step  Size 


Table  2. 

Optimum  Step  Sizes 


NXBIT 

NU 

7 

S 

9 

0 

.002 

.002 

.002 

1 

.005 

.005 

.005 

2 

.006 

.007 

.006 

3 

.007 

.007 

.007 

4 

.007 

.007 

.OOS 

5 

.011 

.011 

.011 

6 

.020 

.017 

.020 

From  Table  2  and  Figure  15  it  is  clear  that  the  order  of  the  unknown 
filter  does  not  affect  the  choice  of  NXBIT  and  optimum  step  size  uq  for  the 
filter  hardware.  This  is  a  very  important  result  in  that  it  insures  that  our 
choice  of  hardware  will  work  well  with  unknown  systems  of  varying  order. 

The  value  of  NXBIT  to  be  used  in  our  hardware  will  be  NXBIT  =  3  because 
the  total  error  of  Figure  15  is  a  minimum  for  this  value.  At  this  value  of 
NXBIT  y*  is  .007  so  that  yQ  will  be  set  at  this  value.  Remember,  as  shown 
in  section  2.0  of  Chapter  II,  the  actual  of  the  filter  is  scaled  by  SCALE  (130 
for  our  case).  The  actual  step  size  is  then  .917. 

As  was  predicted  in  section  2.2  of  Chapter  n  any  effects  on  the  error 
floor  due  to  the  truncation  of  x  are  masked  by  the  finite  arithmetic  errors. 
This  is  seen  in  the  error  curves  in  Appendix  C.  Similarly,  as  predicted  the  rate 
of  convergence,  which  is  evaluated  by  the  value  of  the  total  error,  is  affected 
by  the  division  of  bits  between  e  and  x.  This  is  seen  in  Figure  15. 
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3.0  Sign-Magnitude  Binary  Filter 

In  section  1.0  of  Chapter  II  a  method  was  suggested  which  would  improve 
the  accuracy  of  the  adaptive  filter  hardware.  The  digital  filter  as  presently 
implemented  uses  2's  complement  binary  numbers.  Two's  complement  arithmetic 
was  developed  because  design  of  logic  networks  to  do  sign-magnitude  arithmetic 
is  awkward.  If  a  system  using  sign-magnitude  numbers  can  be  designed  the 
accuracy  of  the  adaptive  filter  will  be  improved. 

In  2's  complement  arithmetic  the  exclusive  OR'ed  sign  bits  of  e  and  x 
must  be  fed  into  the  ROM,  which  calculates  2ye‘'x",  along  with  e'  and 
x"*.  This  is  because  the  magnitude  of  2’s  complement  numbers  are  non- 
distinguishable  without  their  sign  bit.  An  incorrect  update  quantity  would  be 
calculated  in  the  ROM  without  the  sign  bits. 

In  sign-magnitude  arithmetic  the  exclusive  OR  of  the  sign  bits  can 
post-multiply  the  update  quantity  at  the  output  of  the  ROM.  The  magnitude 
of  a  sign-magnitude  number  is  distinguishable  without  its  sign  bit.  Because  the 
sign  bit  need  not  be  fed  into  the  ROM,  all  8  ROM  inputs  are  left  to  divide 
between  e  and  x.  Therefore,  the  accuracy  of  either  e  or  x  is  improved  by  one 
bit. 

The  8  bits  available  for  e  and  x  can  be  divided  in  any  manner,  just  as 
the  7  bits  of  the  2's  complement  system  were  divided.  For  the  sign-magnitude 
system  further  simulations  must  be  run  in  order  to  determine  a  and  NXBIT 
for  optimum  convergence  to  be  used  in  the  adaptive  filter.  The  system  with 
NXBIT  =  4  is  shown  in  Figure  10b  (Chapter  n). 


CHAPTER  IV.  CONCLUSION 


The  purpose  oi  this  thesis  has  been  to  further  develop  an  adaptive  filter 
hardware  and  to  study  the  performance  and  certain  characteristics  of  the  filter 
simulation.  Specifically  we  have  determined  that  NX  BIT  =  3  and  \iQ  =  .007  are 
the  best  values  of  these  two  parameters  to  be  used  in  the  hardware.  NXBIT 
is  the  number  of  bits  to  which  the  input  signal  x  is  rounded  and  yQ  is  the 
optimum  step  size  used  in  the  adaptive  updating  algorithm.  The  optimum 
hardware  configuration  utilizing  these  parameter  values  is  shown  in  Figure  16. 
It  is  intended  in  the  future  that  this  update  hardware  be  added  to  the  digital 
filter  hardware  presently  completed. 

It  has  also  been  shown  that  this  filter  will  adapt  well  to  unknown  systems 
of  varying  order.  That  is,  the  order  of  the  unknown  filter  does  not  affect  the 
choice  of  NXBIT  and  yQ  used  in  the  hardware. 

One  method  of  improving  the  accuracy  of  the  hardware  from  that  shown 
in  Figure  16  is  discussed  in  section  3.0  of  Chapter  III.  Further  study  is  needed 
to  find  additional  methods  of  increasing  the  filter's  accuracy. 

The  results  of  this  thesis  have  clearly  shown  that  hardware  implementation 
can  considerably  decrease  the  accuracy  of  an  ideal  adaptive  filter.  However, 
the  accuracy  of  this  adaptive  digital  filter  is  well  within  the  range  required  for 
many  real  systems  and  should  have  practical  uses  in  many  areas  of  signal 
processing. 


Optimum 

Update 

Quantity 


Figure  16 

Optimum  Hardware  Configuration 
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APPENDIX  A 
Program  Listing 

A  listing  of  the  program  used  to  simulate  the  adaptive  filter  is  included 
here.  As  listed,  the  program  plots  the  absolute  value  of  the  difference  between 
the  unknown  and  adaptive  filters  (error).  The  adaptive  filter  weights  are  also 
listed,  but  not  plotted. 


ap*5o. pub. airforce 


MOn#  APR  5.  1962.  9:5 


« 

5 

6 
1 
6 
9 

10 

11 

11.1 
12 
13 
1 A 

15 

1 7 

16 

19 

20 
21 
22 

23 

24 

25 

§: 

26 

29 

30 

31 

1! 

?! 

3? 

33 

ao 

91 

a? 

a3 

99 

95 

4* 

47 

46 

49 

50 

51 

!! 

53.1 

54 

55 

l\ 

33 

60 

66 

67 

66 

69 

70 

71 

72 

73 

74 

74.1 

74.2 

75 


6C0NTRUL  USLINIT# LOCATION, MAP, LABEL 
PROGRAM  PROJECT 


C 

C 

C 

c 

c 

c« 

c 

C 

C 

c 

c 

c 

t 

c 

L 

t 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

L 

L 

c 

L 

L 

C 

C 

t 

C 

L 

C 

C 

C 

L 

L 

L 

L 


C 

L 

i 


THIS 

fit? 


PROGRAM  SIMuLATtS  A  PIPELINE  RNS  ADAPTIVE 
R,  TRYING  Iu  MAICH  A  USER-ENTERED  UNKNOWN 
R. 


kRI ABLE  IDENTIFICATION* 


PITT 

KRUN 

K 

NO 

NA 

Ml] 

b  u 

NXttJTS 

Nfc«R 

ISL 

X 

JX  u 

I  A 
T 

IT  l) 
YOEC 

A  IJ 
21  U 
It  (] 

1A  1] 
121  [] 
122  U 

t«K 

0 

I  VER 


PlrR  Y 
T  1*0 

STu 

E< 

laO 


U 


NUMBER  of  ITERATIONS  to  row 
NUMBER  of  RUNS  TO  AVERAGE 
NUMbEk  Ur  MOOS  IN  PIPELINE  DESIGN 

number  of  heights  in  unknown  filter 

NUMBER  or  HEIGHTS  IN  ADAPTIVE  FILTER 
ARRAY  OF  MODS  FOR  PIPELINE  RNS  FILTER 
ARRAY  OF  CONSTANTS  FOR  CHI.  rEM.  ALGORITHM 

NUMBER  UF  M  S  BITS  TO  ROUND  X  Tu 
NUM  UF  BITS  FOR  UPPER  LlMJ  I  On  ERROR 
FLAG  FOR  SLOwED-DUwN-UPDATE  algorithm 

INPUT  SIGNAL 

ARRAY  OF  DELAYED  VALUES  OF  InHoT  SIGNAL  AS  INTEGER 
J«l  IJ  CONTAINS  THE  MOST  RECEnT  SIGNAL  INPUT 

ImPuT  SIGNAL  as  integer 

OUlPuJ  FROM  UNrNORN  FILTER 

ARRAY  CURTAINING  OUPUTS  FROM  RNS  FILTERS 

Output  frum  rns  filters,  converted  to  decimal 

LUEF  Ark  A  Y  FOR  UNKNOWN  FILTER  lUAM  TO  NU) 

Delay  lines  for  unknown  filter 

COEF  array  FOR  ADAPTIVE  FILTER  lulM  TO  K*NA) 
array  UF  UELAY  LINES  FOR  A uaP  FILTER  (K*NA) 


UlFfEwtNCE  If.  THt  TWO  FJLTER  OUTPUTS 
STtPaiZt  f UR  UPDATE  ALGORlTn.i 
FLAG  FUR  UPDATE  VERSION  DFSIkEu 


array  OF  STORED  ERRORS  (EVERY  kKun/100  1TE«S) 
array  for  x-axis  of  subroutine  plut 


OtSIREu  STANDARD  DEVIATION 
DESIRED  MEAN  VALUE 
UESIreO  RANDOM  SEEu 


FUR  RAnDOR  SIGNAL 


DIMENSION  lYia),Al2o].Zl(20),Z2(20),lA(«,2dJ,lZl(4,20) 

C,  122(4,20)  #« »oU)  »  JX(2d)  .PERRY  C 1  0 1 )  .PKUDImJ 
C,TIM(i01 J , 1CUEF  lido, id) ,CUEr(100,10)»01A(2dJ 
REAL  ISO 

DOUBLE  PRECISION  B, Prod, China 

DATA  lY/4*d  /  »«/2d*d.v/,Zl/2d*0.0/.  Z2/20*0.d/»  IA/BOao/.  IZl/6t*«d/ 
C* IZ2/B0*0/.M/r*w/, Jx/2d*0/, PERRY/ \ 01*0/ » 

c  riM/ioi*d.o/ 


INITIALIZATION  oLUCk  (USER  INPUT) 

WR1TE(6,«) 'ENTER  «  OF  ITERATIONS  TO  RU.. 
#EAD(5.0Pin 

(PITT  .LT.  bddd)  VAHsl 
bddd)  VaRsIO 
\R  OF  RUNS  TO  AVERAGE?' 

..  GOTO  9 
VALUER  I  ABLE 


(IduO. 5000, ETC)!' 


IF  (I 


Guio  7 

WRITE  (6.*)  'NUMBLR 
RtAU(b»*)  KMSE 
WRITE  (6,0  'hOw  many 


PARAMETER! ' 

OF  ITERATIONS  TO  AVERAGE  Fur  MS  ERROR?' 
WEIGHTS  IN  THE  UNKNOwn  FILTER?' 


sf 

80 

89 

90 

91 
9? 

92.1 

93 

94 

95 

96  . 

96.1 

96.2 

96.3 

96. 5 

96.6 

97 

98 

99 
00 

00.1 

00.2 

00.3 

01 

01.1 

01.2 

01.3 

01.4 

01.5 

01.6 

02 

03 

04 

05 

06 

07 

08 

09 

10 


■  •  w  » 

ii:i 

11U«5 

11.5 

11.6 
12 

13.1 

13.2 

14.1 

U:! 

114.4 

i;-5 

i* 

10 

119 

120 
121 


READ  (5**)  NU 

WR1TEC6#*)  'HO«r  MANY  w£I6HTS  IN  THE  ADAPTIVE  FILTER?' 

READ (5, •  )  NA 

«KITE(6'*)!tli?Ek  NUMBER  OF  H  S  BITS  TO  ROUND  *  TOt  2, 3, 4, 5.* 
w«ITE(6,*) 'EmTEr  0  If  X  IS  NOT  TO  BE  ROUNDED*' 

READ (5* • ) NXel T 

IF  (NXB1T  .&£.  0  .ANU.  NXBIT  .LE.  6)  GOTO  17 
wRITEC6,*)tUnA0LEP1 ABLE  PARAMETER  1  * 

6070  16 

WRI7E(6»0 JENTtR  NUMBER  OF  BITS  FOR  UPPER  BOUND  ON  ERROR' 

s?ijn?s«EftooL‘' #E '  *  *  of  bits  ',ob  *• 

1F«i¥fei.;Sf *oS*£cfc^t.BuE*>p*l;lAETii»T9T'J  “ 

GOTO  17 

K*4 

SLRRcO. 

DO  20  1=1,101 

TIM(1J*FluAI (1*1)* [PITT/1 00) 

DU  22  L*l,loO 
00  22  1*1, NA 
COEF (L » 1 5  *0 
CONTINUE 

00  30  11*1#  NRUim 

CALL  MAIN  (X,  IX,  Y,lY,  A.  Zl,Z2. 1A,  121,  I22,K,NU,nA,B,  JX, 
CPERKY,KRUN,P1T1 , V ah , 1 1 , NXB 1 T , NEHR » I SL , PROD , 

C11,U,M, SCALE, STU,NX, 1 SD, 1CUEF) 

DO  30  LS1 , 1 uO 
DU  30  1=1, N* 

COEF  CL, I ) s  CUtF IL, 1 )  ♦FLOAT C I CUEF (L , I ) ) / ARUw 

SWfi"KI..,i 

wkITE  (2,*)'A0AHllVfc  WEIGHTS  GIVEN  EVERT', 
CPlTT/luO.f'lTtNAllUNa' 

OU  31  L=l,100 

WRITE  lit*)  IIFIAICUEF (L,I)),I=1,NA) 

CONTINUE 

WRITE (2,*) . 

*K  1 1  £  1 2 »  *  )  *  FINAL  ADAPTIVE  COEFFICIENTS  ARE !  * 
wRIT£(6,*)'  FINAL  ADAPTIVE  COtF F I C Itw 1  a  Ant;' 

DO  90  J= 1 , R  , 

WRITE  (2,  «01  MIJJ,  UAU,1),1  =  1,NA) 

WRITE  (6,60 J  NIJ)  ,  ilAU,l).I  =  l,NA) 

FORMAT(s  MOD', 13, ', 1016) 


CONllNUE 

CALL  DECIMLlwA,*, I A, Di A, fa, M, PROD) 
wrIJE  CP* • , 1 
wRlTfc  (6,*,'  , 

wR  1 1  E  lit*}  UpmDIAmi,I  =  l,NAl 
WRITE  (6,*)  IIFIXIUIAIIJ) ,1=1,NA) 
whITe (2,*) 
wR I T  E (6, * )  , 

DO  95  1*1, Ivl 

PERRY  Cl  )=PtRHTU)  /FLOAT  (KRUN) 

IF ( (!• C (XMSt/ t IF  I A (Hi  I T/l 00. ) ) ) ♦! ) ) )  94,95,95 
SERRsSERR  ♦PERRY  11) 

CONTINUE 
wRl T  E (6, • ) 

WRITE  (2!  *',  !SUtn  UP  ERRORS*',  serr 
wRITEC6,*(  'Suh  UF  ERRORS*',  SERR 

wRiTEcilAivERHUR  VALUES  GIVEN  EVERY ', PITT/ 1 00. , 

eai!lK«KN  hy 

|ALL  PLOTCTIM, PERRY, 101,0) 

END 


'SUM  UF  ERRORS*',  SERR 
'Sum  UF  ERRORS*',  SERR 


(TIM, PERRY, 101,0) 


•MAIN  SUBRUU I l HE ••*••***•**••♦*•*•*• •••••*•*••••• 


SUBROUTINE  MAIi* ( a,  IX,  Y ,  1 Y ,  A , 21 ,  Z2,  l A,  121 , 122#  A,NU, NA,B, 


.  i  i.in\A 

nmVnM 


'iiauiiiii 


Tu»tx,l 


ri. 


this  subroutine  simulates  the  two  filters  and  compares 

OUTPUTS 

DIMENSION  IYU),  a(NU)  »Zl  (NU),Z2(NU)  ,1AU,nA)  ,1Z1  (K,NA), 
C1Z2U»NA)  »  MUJ  ,oUTr  iO*(A»NA)  »  J*(NA)  ,PtHr<y  U«1  J  ,PROO(K) 
C||WU  J  4>lAlNAJ  ,1LUcF  U00»NA) 


DOUBLE  PRECISION  D,PRUD, CHINA 

CALL  INIT(lY,lA,12l,122,K,NU,NA,JX,II) 


•  INITIALIZATION  BLUlK  • 

IF  (II  .ST.  U  60(0  « o 
*  OPTIONS  FOR  FILLING  fcMHUK  ARRAY 


WRITE(6»*) 'AVERAGE  THE  ERROR  VALUES  OR  JUST  SAMPLE?' 
wRITtU#*}  #T0  JUST  SAMPLE#  PRESS  1* 

RE AO  (S#*)  II 
C 

C*  OPTIONS  FOR  UPDATING  ISLUWED-UOWN 

6  NR1TEC6. •) 'SLOAtW-00«N  UPDATING  OR  UPDATE  EvERY  ITERATION?' 

WRlTElb.*j'1u  OPuATt  EVERY  ITERATION,  nlT  1,T 
wkITE (6#  *) ' TO  SLOrt  Down,  HIT  2,' 

R£au(5»*) ISL 

IF  IISL  .EU.,1  .UK  I&L  ,E0.  2)  GOTO  9 
WRITE (6, • J 'UNALLEP I  ABLE  PARAMETER  I  * 

GOTO  6 

t*  Input  coefficients  of  unknown  system 

c 

V  UO  10  1*1, NU  , 

WRITEIO,*! 'VALUE  EOR  A(',I,')?' 

read (5#  » ) A  (1 J 

10  CONTINUE 

c*  initialize  muds 

M(1)S1J 
M  ( 2  )  s  1  3 
M  ( 3 )  s  1 5 
M(A)slfa 
DO  20  Jsl.R 

DO  20  L*1 » NA 

IACJ#l)smU0PUA(J,L)  ,M(J)  J 
«fO  CONTINUE 

wRITfc  (6, *)  'ENTER  MU  Fuk  UPDATE  ALGUk  I  T  n<l  • 

REAUC5,*)  V  , 

NRlTECb.*)  ENTtk  SCALING  FACTOR  Fuk  RfvS  FILTER  INPUTS' 

READ (5, *) SCALE 

l *  input  Information  fur  random  number  GEneratuk 
w«ITEIS,a3. 

WRITE (b.A) 'UESlRtU  S1AN0ARD  DEVIATION?' 

HtAU(5#*)SIU 

wRITE(b,A)  DtSiREU  Mean  VALUE?' 

REAUlSf a)EX 

WRlTE(b#Al'DESiREU  RANDOM  SEED?' 

READ(5#*)ISU 

c*  input  validation  •  echo  check 


WRITE (2# •) 'a* * a **«•*•••*«•*•**•**•* ****** *•**•*' 
nh  ,T|  i  2 » • ,'  *RhS  PIPELINE  ADAPTIVE  FILTER  SIMULATION' 
wR  TEi 2, a; 

write  a,*!  *  A-A-t-  parameters  initialized  as  folk 


parameters  initialized  as  follows*' 


*wlTE(2#A| 

WRITE (2,799)  KKUN,PI(1 

F0RmaT(X#1«# *  RUNS  Uf»  ,F  7 .0,  '  ITERATIdnS  tACH,',/) 
wrhe(2»sod)k,  (Mill, i*i, kt 
white  (brbVGJK#  IrtU)  ,  1*1  ,K) 


21« 

215 

215 

217 

210 

219 

220 
221 
222 
223 
220 
225 
225 
227 
220 
229 

229.1 

229.2 

229.3 
229.0 
229.5 


11 

200 

201 

202 

203 

240 

205 

205 

295.1 

207 

209 

250 

251 

252 

253 

250 
255 
255 
257 
250 

251 

252 

253 
250 

iti 

ill 

in 

iu 

27  0 
2.75 
275 
277 
270 
279 


mKitT  II  ?I8 1  >  YH!  J »  I*T! *1 ) . "r . . . . 

FONMATt^UN^UwN  p}lUr  COEFFS  INITIALIZED  Tu:  ♦, /,  IOF0.5/J 

WRITE (2*002) STu 

wRITE(6,0O2)STu 

F  URMATl/ * *  RANDOM  SIGNAL  PARAMETERS:*,/**  STAN  DEVIATIONS 

WRITg(2,8C3)EA,ISu 

NNlTE(5.0O3)tA»i5O 

FQRMaTI*  MEAN  VALO£s», F3. 0, /, *  RANDOM  SEEDS  * ,F 1 0.0/) 

WRITE (2,*) 

NR ! TE (2 t 000) 0,NAdlT,NERR 

FOHMATT*  FOR  UPDATlNfc: *,/. *  MUs',F0.5, /, 

1  »  nu«  of  Sits  k  Roundeo  T6r’»i3,/,  .  % 

2  *  NUM  UF  BITS  ALLOWED  FOR  ERRuk I  * , 1 3* / ) 

IF  (ISL  .EO.  2)  WRITE12,*) ;NOTE*SLOWED-OOWN-OHOATINSi *  , 

IF  il$L  l)  *»*ITE12,0  *N0TEIUPDATE0  EVERT  ITERATION,* 

WRITE (2#*) . 

WRlTECZ**)**** SCALING  FACTOR  FOR  RNS  F IlTER *» SCALE  *****  * 
wRITE(2»*) 


ANDOM  siSNAL  PARAMETERS!**/**  STAN  DEVIATION** ,F5. 3} 
EX  *  i  $u 
Ex, ISO 

N  VALUE*  *»FJ,0*/» *  RANDOM  SEED* * *F 1 0.0/) 


>  NXdl T *  NERR 


C  *  BEGIN  FILTER  SIMULATION  • 

C  •»•»**«*#»**»,*«.„*„*«*,» 

c 

CALL  WEIGHT  (m, B*K, PKUD) 

40  ERR  s  9.0 
ICNTRsO 

DU  01  L*1 *  1 00 
UU  41  1*1 #  NX 
ICUEF (L , I ) *0 

41  CONTINUE 
JTtNsl 
SUMMsO 

J1*IFIX(P1TT/Uoo.*VAk)) 

IXU*0 

1x1*0 

1X2*0 

DO  200  Lsl.lOU 

DO  100  LP1*1* IFlX(HITT/100.) 

£•  obtain  and  scale  input  signal 

CALL  normal  (STO*EX, 1SD»X) 

Ixsa*SCAlE 

£•  HOUND  IX  TO  M  S  BITS  •>  IhIS  VERSION  OF  IX  GOES  IU  UPDATE  ALG0«I1^ 

l  out  original  lx  is  passed  thro  adap  fltk 

t 

ixx*ix 

lX=lROUND(I*»NXbl 1 ) 

m  i a  us i *2 

1X2*1  X 

c 

L*  UPDATE  DEL A T  BLOCK  jx 

C  JX(1)  CONTAINS  Int  MUST  RECENT  SIGNAL  INPUT 

L 

NAMlsNA-1 
DU  102  1*1  *  Namx 

JX(NA^1-11«JX  INa-1) 

102  CONTINUE 
JXU)sIXO 
C 

C*  PASS  X  THRU  UNKNOWN  FILTER 

c 

CALL  UNKNOw lx*A*Zl, Z2*T*NU) 

C 

C*  PASS  X  THRU  ADAPTIVE  FILTER 

CALL  ADPT1V(IXX*IA, 1Z) , IZ2,M,NA* IY,K) 

C 

C*  CONVERT  ADAPTIVE  RNS  OUTPUT  TO  DECIMAL.  TrtEw 
0  CALCULATE  ERROR  BEThEEN  ADAPTIVE  FILTEh  A  no 

t  UNKNOWN  FILTER 

L 

FCH jNAsCHl NA (lY,b*K,M, PROD) 

TDtCsF CHINA/ SCALE 
ERR* ( T*SC AL&) vYOfcL 

fe*  UPDATE  ERROR  ARRAY 


?ei 

282 

263 

269 

265 

gib 

287 

gge 

269 

290 

291 

292 

293 
299 

295 

295.1 
29b 
297 

296 

299 

300 

301 

302 

303 
309 
305 
30b 

321 

321.1 

321.2 

321.3 
321.9 
32!  .6 

322 

323 
329 
325 
32b 


328 

i!o 

331 

332 
33« 

335 
33b 
337 

336 
339 

391 

392 
392.1 

393 
395 
39b 

397 

398 

399 

350 

351 

352 

353 
359 

355 
35b 
357 

356 
359 
3b0 

ill 

3b3 

3b9 

3b5 

Ibb 


ABSERRsAbS (ERR7 

SUMMBSUMM+ABStRk 


IF  CLPlE*^||fel^l*tPlTT/100.3)  GOTO  105 

if  (II  tEu!  1)  GOTO  109 
?ik?!liTt«J*ijo^*suMM)/pjTT9pEk«ri 


CONTINUE 


SUHMSO 


•  tu,  1 


kkt (ITEN)*ABbEkk*P 


MU 


CITEN) 


C*  CHANGE  OUTPUT  FROM  UNknUwn  INTO  EACH  OF  THE  GIVEN  MODS 
C  COMPARE  Tu  KN5  OUTPUTS  (COMPARE  RESPECTIVE  MODS) 

C  AND  OE TtRMIivt  APPROPRIATE  $TEPSIZ£S>  AND  UPDATE! 


AND  OETt«MI,vt  APPROPRIATE  STEPSI2ES;  AND  UPDATE 

ICNTR*ICNTR+1 
LMUDbMOD (ICNTR#b) 

IF  (ISL  .EG.  27  »U Tu  106 
ERRlsERR 
BOTO  1 S  U 

IF (LMOD.LT .1 )  UUTu  10u 
IF (LMOD.GT .6)  GUlu  1WU 
IF (LMOD.NE* 1 7  BO  T  u  110 
ERRlsERR 

CALL  UPDATbU*,U»  Y,  IY,nA,ER«W  IA,m,K,LMUO*NER«» 1SL) 
CONTINUE 

CALL  DECIML (N A , A , 1  a , 0 1 A , B , M , PRUD) 

OU  92  Isl.wA 

1CUEF(L#I)*U1AUJ 

CUNTINUE 

CON  I  1  NOE 

RETURN 

EnU 


•  INITIALIZE  5Ub*uuTInE  ■ 


THIS  SUBROOT  I  Nt  I  im  1 1 1 AL12ES  SOME  ARRAYS  TU  ZE*u 

SUBROUTINE  InIT  lit, I  A, 121,  IZ2,K,NU,NA, JX, II ) 
DIMENSION  1Y(*7 , 121 IR,NA) , 1Z2(*,NA) » IA(A»NA) , JX(NA) 
UG  10  1 s 1 • K 
IVClJsO 
UO  10  Ls 1 »  N A 
IA(I, LJ  =  y 
IZ1  (1.L7BW 
1 Z2 ( I » L) *0 
JX(L)=U 
CUNTINUE 

IF  111  «GT •  1)  GUT  u  90 
UU  20  L*1»NA 

NRlTE(b,«j'lNlT  VALUE  FOR  JA(l,',Lr*)' 

REA015.«)I*U»L7 

CONTINUE 

OU  30  Is2»K 

UO  30  Ls 1  *  na 
1A(I,L)*1»U»L7 
COnT INUE 
return 
EnD 


*  china  FUNCTION  * 


FUNCTION  CHlNAUT»b?A»MrPROD) 

DIMENSION  JYU)  ,BU)  ,  MU),  PkOD  (K) 

double  precision  LHiNA,b,PRoo»p«ooM 

CHINA  B  o 
UU  10  lBl,R 

CHINAbCHIWA+BU)aIY(I)»PWOO(I) 

CONTINUE 

PRUOMsM ( 1 ) *PROU (17 

ChInabCHINA»wDIn I ICnlNA/PRODM) *PRU DM 

IF  ((CHINA/PRUuMi  ,6t.  0,5)  CHINASCHInA-PRUuM 

RETURN 


45 


IRuUND  FUNCTION  * 


SAD 

361 

382 

383 
$84 
385 

391 

392 

393 

394 

395 
398 

397 

398 

399 

400 

401 

402 

403 
403.01 
403.02 
403. U3 
403.  i>4 
403.05 
403.08 
403.07 
403.08 
403.09 
403.1 

403.11 

403.12 

403.13 

403.14 

403.15 
403.18 
403.17 

404 

405 

408 
407 

406 

409 

410 

411 

412 

413 

414 

415 

418 
417 

416 

419 

420 

421 

422 

423 

424 

425 

426 

427 

428 

429 

430 

431 

•if 

434 

435 

436 

437 


FUNCTION  IROUNU  llX.NXBIT) 

IF  (NXBIT.NE.O)  GOTO  10 
IkOUND  «  ISIGnUBB,!*) 

NET  URN 

LX  *  2*«(7-NXblTJ 
INUUNO  b  LX*  1 1X/LX) 

Return 

end 


*  PUS17IVE  HOU  FUNCTIUN  * 


FUNCTION  MODP(l#Mj 
IF  (MOD  (I»PO»GE.UlGUTU  10 
M01)PsM*MUD  d»MJ 
RETURN 

10  MODPsMODd'M} 

RE lURw 
END 


*  CONVERT  TU  DtCIMAL* 

SUBROUTINE  DEC  I  ML  In A , K , I  A , D I A , B , M , PRUU ) 

DIMENSION  lAlK.NA  )  ,UlA  (NX)  #b(K)»M(K)#  PROD  (K)#Iw(Kj 
DUUDLE  PRECISION  8  , PRUO  »  CH I N A 

00  10  ISlrNA 

DU  20  J=1 ,* 

Ir>lJ)  =  IA(JfIJ 

continue 

DIA  (I)»CH1NA  (In.  6#K,  M,  PROP) 

CONTINUE 

re  turn 

END 


•  UPUXTE  SUbrtUuTIwt  • 


SUBROUTINE  UPua  te  c JX#  U, Y, I Y , NA.ERR, IA,M#K»LM0D,NER«» I  SI 
DIMENSION  JX  (NAT  »M(iO  ,  IY(K)  ,  1A(K,NA) 

DIMENSION  kk(k#NMT 

THERE  IS  UNLY  ONt  DELAY  LINE  OF  THE  INFDI  SIGNAL. 
UPDATt  ALGORITHM  USES  THESE  DEL  A  Ytu  VALUtS.  USING 
MODULAR  AKllHMEllC. 


•  ••VARIABLE  IDtNTiF 1CA TIDNJ 1 


TU  *  2*0 

k y  *  Output  y  from  unknown,  as  integer 
ISTEP  *  SlZt  UF  STEP,  EITHER  M(l)  Or 

ERRUR  BETWEEN  THE  T*U  FlLTtKS 
ISL  *  Flag  FUR  SLO*ED-DOwN-UPDATE  ALGORITHM 


IN  AUDITION#  the  UPDATE  ALGORITHM  USES  TwO  DIFFERENT 
STEPS1ZE  INCREMENTS.  DEPENDING  ON  WHETHtR  Ok  nOT  ThE 
ERROR  IS  LESS  Tn AN  TmE  SMALLEST  MOO. 

1STEP*ERR 

IF  ABS (ERR) >2**NfcRR*l #  fcKROR  IS  FIXED  AT  SAME 

IF  (lAeSdSTEPT  .LE.  2**NERW-I)  GOTO  15 
JSTtP*2**NtRR*l  _  ... 


ISTtP*2**NtRR»l  . 

IF  (ERR  .LT,  UJ  iSTtP«-ISTEP 
IF  (ISL  .EU.  1)  GUTO  bU 


•UPDATE  ONE  COEFFICIENT  U*LY  ON  COUNTS  1  •  «  ^ 

ITEMPs2*(U«lST£P)»jxiwA) 

NAML*NA»l-LMOD  .  _  . 

IF  ( (NAML.LE.WJ .UK.IWAHL.6T.NA))  WRITE  lb# *) *BUoNDS  TROUBLE! 
DO  iO  J*1,A 

KTEMP*1AIJ,NA«l)*ITEMP 
I  A  (  J  » NAML  J *MUOP (* I £MP  *  M  (  J  ) ) 

CONTINUE 

return 

UPDATE  EVERY  J  T  ERA 1 1UN 

DO  60  Jsl/>NA 

ITEMP«2* (U*1ST  tP) • J  X  (I) 

DO  60  J*1»R 

KTEMPslAU#  D  +  iTENP 
IA(J,lJ*MUDP(* IEMP,M(J)) 

CONTINUE 

RETURN 

END 


*  UNKNOWN  filur  subroutine  * 

DUMMY  VARIABLE  declaration: 
x  :  INPUT 

AIJ  *  AKNAT  Uf  COEFFICIENTS 
Z1  l)  :  DLLA  r  AhKAY  1 

Z2U  :  delay  akkay  ii 
y  :  Output 

N  :  NUMBER  UF  wtlSHTS 


SUBROUTINE  UNKNUW l X , A , Z 1 , Z2 , Y , N ) 
DIMENSION  Al lv;,ZUN),Z2(N) 

UPDATE  Z2  FIRST 

NM 1 SN» 1 
DU  10  ISi.NMl 

Z2U)stl  ll)*Z*ll«lJ 
lu  continue 
Z2(n)c21  (M 

UPDATE  Z1 

DO  20  I *  1 # N  ,, 

Zl(IJsX*AlI) 
tQ  CONTINUE 
YSZ2U  ) 

RETURN 

END 


*  ADAPTIVE  filter  subroutine  * 

SUBROUTINE  AUPTIVIXX'1A'1Z1(XZ2»M,NA,1V'R) 
DIMtNSION  iACXfNA^,  IZHK,Na)  ,  IZ2(X»NA)»M{K),  IT  (K) 

UPDATE  I Z2  FIRST 

DO  So  J*li* 

NM1«NA-1 
DU  10  lel.NMl 

1Z2(J# 1)*MUDP11Z1 U,I)<>IZ2(J#I*l),MlJ)J 
10  CONTINUE 

IZ2(J,NA)slZl  Uf*«A) 

UPDATE  IZ1 

DU  20  1*1  * NA 

IZ1  CJ,1)*NDUPUX*1A(J,I),N(J)) 


20  CONTINUE,  %  ,  % 


MWP- 


SUBROUTINE  wEI&Hl  (M'B'K'PROD) 

DIMENSION  M(K),b(K) .PRQD(K) 

DOUBLE  PRECISION  B,PkuD 
REAL  MF 
DO  100  Ixl , K 
MF*1 

DO  10  J* 1 t K 

IF  (J  .EU.  1)  GOTO  10 
mpsmmmTjJ 
CONTINUE 
PROD  Cl) *MF 

MF«AMODiMF.FLUAl  (MU))) 

JP0INT*MU)-1 

D°  20N^Avi*JUiNl 

ITfcMPslFlA(AMOD(MF*J,FLOAT(M(l)))) 
IF  l IT tMr  ,£y.  I)  GUTQ  30 
CONTINUE 

WRITE  (6,25)  ^  . 

FORMAT  (X,T  ERROR  25*) 

8(1) sFLOAl (NSAVt) 

CONTINUE 

RETURN 

END 


SUBROUTINE  TO  GENERATt  A  NORMALLY  DISTRIBUTED  RANUQM  VAR 
VARIABLES: 

EX  x  DESIRED  mean  VALUE 

STD  *  DESIRED  STANDARD  DEVIATION 

ISEED1  *  SEUUENCt  SlAkTING  SLED  1 
R V 1  s  RtTURNtU  RANDOM  NUMBER 


SUBROUTINE  NORMAL  (STD, EX , I SEED1 , R VI ) 
REAL  ISEED1 


.....IF  STD  IS  0,  THEN  DU  NO  COMPUTATIONS 
IF  (STD.EO.0.O)  6UTU  20 

. GtNERATE  RANDUM  *6  AND  SCALE  TO  LIE  wIThIN  («1,1) 

WRITE (6,*) *2.Xx»,HVl, *  STD**, STD, *EXx*,£X,*ISDx*,ISEEDl 
I  X 1  *•!  .0+2.y*RAN0llSEtUl)  . 


Xls-1  .©♦2,y*RAN&USEtUl)  . 

WRITE(6,*)*AT  All. I,  tX*»,EX 

WRI T£  lfe» * J  ^3. Xx^, K v  U  sio*  *»STD»*EXx*»£X, * ISU*  * , I  SEED  1 


..FIND  THE  NORM  SUUARtO  OF  (X),X2) 
SxXl*X]+X2*X2 

WR1  1 E  (6, *) *AT  A1B.1,  EXx  » , EX 


..CHECK  TO  SEE  IF  (XI, X2)  LIES  WITHIN  UNIT  CIRCLE 

wRlIflSfsi’Al^iS.iJf  tXx  * ,  EX,  *  X 1  *  * ,  X 1 ,  *  X2*f ,  X2 ,  *  S*  * ,  S 
,  .IF  SsO  THEN  GENERATE  APPROPRIATE  NORMAL  RANDOM  NUMBERS 


WRf?£fG?*J^A^  H*il,  EXx*, EX 

. GENERATE  NORMAL  RANDUM  NUMBERS 

wx5wRT((*2,0*ALUtt(S))/S)  . 
*R1TE(6,*)vA1  A2B.1,  EXx  * , £X 


Kvi«EX+Sip*#*M 
WR1TE(6#*) *AT  4 
RETURN 

RV1*EX 

RETURN 

END 


* AT  420,1,  EX*', EX 


PLOT  IS  A  SUBROUTINE  F UK  PRINTING  A  2-D  GRAPH  UF  2  VARS 
-VARIABLES*””””-;*””-— 


XI  A  SINGLE  SUBSCRIPTED  REAL  ARRAY  DIMENSIONED  TO 

NPTS  IN  MAIN.  X  FORMS  THE  AXIS  OF  THE  ABSCISSAS 
OF  THE  GRAPH. 

Yl  A  SINGLE  SUBSCRIPTED  REAL  ARRAY  DIMENSIONED  TO 
NPLOT  IN  MAIN.  Y  FORMS  THE  AXIS  OF  OkOINATES  OF 
THE  GRAPH. 

NPTS I  NUMBER  OF  POINTS  TO  BE  PLOTTED  FOR  EACH  PLOT  ON 
THE  GRAPH. 

IT:  DETERMINES  NHEIHER  X  AXIS  IS  LINEAR  OR  LOG 

ITs!  •»  LUG  SCALE 
IT  NOT  1  •>  LINEAR  SCALE 


SUBROUTINE  PLUT  l X, Y # NPTS, IT) 

REAL  XCNPTS),Y(NPTS)»XSCALtll) 

LOGICAL  PT 

CHARACTER  BL, BLANK, OlV .BAR, MINUS, PLUS, LInE(1 01) ,SYMBl?) 
DATA  BLANK/*  */, B AR /'.*/, MINUS /'•’/» PL US/ '♦,/»SYMB/*X*,,0* 

...CHECK  TO  SEE  IF  sPlOTS  DESIRED  IS  I  OR  2 


.initial  data  set  up— -find  MAX  VALUES  UF  X  and  Y 

YMAXs Y ( 1 ) 

YMlNsYMAX 
UU  20  Jsl.NPTS 
YTsY ( J) 

IF  (YT.GT.YMAX)  YHAXsYT 


IF  (YT.6T.YMAX)  YHAXsYT 
IF  (YT.LT.YF.iw)  YMINs  YT 
TINUE. 


CONTINUE 
XMAXsXil ) 

XM1NSXMAX 

DO  SO  Jsl.NPTS 
XTsX(I) 

IF  (XT.GT.XMAX)  XMAXsXT 
IF  (XT.LT.Xh1h)  XMlNsXT 
CUNTINUE 

i . F I NU  THE  RANGE  OF  Y  AND  X  VALUES 
yrsymax-ymin 

XKSXMAX-XM1N 

•CHECK  TO  SEE  IF  LOG  SCALE  (ITsl  e>  LOG  SCALE) 

IF  IIT.NE.1)  GOT U  Su 

•CALCULATE  SCALING  FACTOR  NEEDED  TO  PLACE  PUInTs  ON  LINE 
DFL* ( ALOG1V (XMAX J«ALOG10(XMIN)) /1 00.00 
..CALCULATE  SCALING  FACTOR  NEEDEO  TO  PLACE  SCALE  ON  X-AXIS 
OFslO.*»((ALOGlVUMAA).ALOGmXMXN))/lO.OO) 

..SET  UP  EACH  LINE  UF  GRAPH  (HORIZONTAL  GRID) 

I  YS*0 

WRITE (2*  900) 

oo  is  a  m«j,si 

IYA«52W1 Y T 
I YS* I YS*1 
blbslank 
OIVbBAR^,. 

PT«, FALSE. 

IF  (1YS.NE.I)  GOTO  60 
BLbMINUS 


DIV«PLUS 

PTa.TRUt. 

YSCAL*YMAX»(1T  f  »1 J *  VR/50 • 

.SET  UP  VERTICAL  SKID 
DO  70 

L INc ( I A A  J  «oL 
DO  60  IXA«l,lvi,10 
LINE ( I XA ; «u I v 

.INSERT  DATA  POINTS  ALONG  GRAPH  LINE 
DO  110  M«1 » NPTS 


IY*50«*lYlM)»YHlN)/YR*l»R999 
IF  Til, HE. 1)  GOTO  00 
IXs(AL06mX(H))»AL0G10(XMIN)) 
G010  100 

IX*100.» lx IM)-XMIN)/XR+1 ,«999 
IF  (IT.NE.ITA)  GOTO  110 
LINEilA)«STHb(l) 

CONTINUE 


/DFL*U«999 


,PR1HT  Y*AXIS  VALOt  EVtRT  FIFTH  RON  IF  PT  IS  TRUE 

IF  (PT)  *RlT£(i,lW00)YSCAL,LlNE 
IF  (.NOT.PTj  t*Rmi2,ilOU)LlN£ 

IF  (ITS.EU.S)  1YS90 
CONTINUE 

,PR1NT  X-AXIS  SCALE  VALUES 

00  ISO  I XM* 1.11 

IF  (1T.NE.1)  SUT  0  1  <10 
XSCAL(IAM)sXMlN*OF**(IXM-i) 

GOTO  150 

XSCAL(I*P)=XHlN*iiAM«i)*XR/10. 


900 
1000 
1  1  00 
1200 
500 


CONTINUE 

«HITE(2'l200)XSCALll),XSCAL(3)'XSCAL(5)'XSCALl7),XSCAL(9), 
CXSCAL(11)»*|5AL12)#XSCAL(A) , XSCAL (fc) » XSCAL 16) » XSCAL(IO) 
FORMAT (1H1»*PLUT  UF  InE  ERROR") 

FORMAT l '  *»5X,1G11.«,1X,101A1) 

FORMAT?*  %17X,101A1) 

FOKMAT('0,»3X»bG2o.3/13X*5G20,3) 

RETURN 

END 
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APPENDIX  B 
Simulated  System 


The  system  simulated  by  the  program  in  Appendix  A  is  shown  in  Figure  17. 

The  signal  is  scaled  by  SCALE  at  several  points  In  the  system  because  the 

Residue  Number  System  requires  integer  arithmetic.  We  would  like  SCALE  to 

be  as  large  as  possible  without  causing  the  system  to  exceed  the  RNS  numbers 

available.  Because  we  have  chosen  the  mods  11,  13,  15  and  16  the  range  of 

integers  available  is  (-1  /2(1 1«13»15*16),  1/2(1 1*1 3*1 5*16)).  To  calculate  the  value 

of  SCALE  to  use  we  will  assume  the  system  is  a  pipelined  TDL  with  the  weights 

n 

w.  normalized  such  that  £  w.  =  SCALE.  The  output  of  the  filter  is 
1  i=o 


which  is  less  than 


n 

Yi  =  .1  w.  x(i-2) 
i=o 


I’Wi'.?  wi 

j=o 


If  the  input  signal  is  assumed  to  be  maximum  at  the  value  SCALE  the  output 
becomes 

>max  -  <SCA1-e2> 

which  must  not  exceed  the  range  of  RNS  numbers,  therefore: 

ymax  =  1/2C11*13-15»16) 

SCALE2  =  1/2(1 1*1 3*1 5*1 6) 

The  value  we  will  use  in  the  adaptive  filter  will  then  be 


SCALE  =  130.996. 


Figure  17 

Simulated  System  Diagram 
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APPENDIX  C 

Error  and  Adaptive  Weight  Plots 

Contained  here  are  the  error  and  adaptive  weight  curves  for  each  shown 
in  Table  2.  These  were  obtained  from  simulations  of  each  combination  of  NXBIT 
and  NU  run  at  their  optimum  step  size.  The  filter  weights  should  converge  to 
normalized,  scaled  versions  of  those  in  section  2.3  of  Chapter  II.  These  values 
are  given  in  Table  3. 


Table  3. 

Normalized,  Scaled  Weights 
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